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NETWORK DELIVERY OF 
INTERACTIVE ENTERTAINMENT 
COMPLEMENTING AUDIO RECORDINGS 

BACKGROUND 

5 1. Field of the Invention 

This invention pertains to the field of computer 
networking, and more particularly to the use of network 
protocols to provide services to users that are related to CD 
ROMs, audio recordings and other distributed media. 

10 2. Related Art 

Over the past few years, on-line services have experienced 
explosive growth and have become a major new form of 
entertainment. Alongside this new entertainment, more 
traditional forms such as musical recordings have continued to 
15 be consumed on a massive scale. 

The traditional experience of the musical recording is 
listening by a small group of persons gathered together in a 
room. The music fills the room acoustically, but there is 
little associated visual content, and there is only a limited 

20 interaction with the recording, consisting essentially of 
deciding which tracks to play and performing simple 
transformations on the recorded sound, such as setting the 
volume or applying an audio equalizer. This traditional 
experience dates back to the early age of 78 r.p.m. musical 

25 recordings almost a century ago. 

The traditional production of a musical recording 
complements the traditional experience of the recording. The 
recording is produced in a number of recording sessions, subject 
to careful mixing and editing, and then released to the public. 
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At that point, the recording is in * * 

g ls in a flxed form, nowadays an 

n I " hOSS PUrP ° Se 15 t0 - £a """"V - P-siMe 

th. fl nal sonic experience designed by its authors. the 

musicians, producer, and recording engineers. 

■ Music videos have supplemented the traditions! experience 

of musical recordings by allowing the association of visual 
content with tracks of such a recording, m prac tice, however 
music videos have been broadcast, with all the problems of lacx 
of user control which that implies, and they have not 
contributed to interactivity or participation by the consumer. 

0„-li„e services offer opportunities for enriching the 
experxence associated with prerecorded material. The present 
invention is addressed to computer programs, systems, and 
protocols which can fulfil this promise. 

SOMORJt OF THE INVENTION 

It is therefore an object of this invention to provide 
computer programs, systems, and protocols which allow producers 
to deliver entertainment complementary to distributed media 
recordings by means of on-Une services such as the Internet. 

is a further object of this invention to provide computer 
programs, systems, and protocols which allow such complementary 
entertainment to be meaningfully interactive for the consumer, 
such that the consumer can also be a creator of the experience. 

It is a further object of the invention to achieve the 
foregoing objects by means of implementations designed to attain 
integration with existing environments and programs 
particuiarly on the Internet, while retaining the flexibility to 
adapt to the continuing evolution of standards for on-line 
services. 
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In a first aspect of the present invention provides a means 
for producers and sellers of distributed media such as CDs to 
maintain and strengthen their connection to their customers. 
Record companies download and periodically update a central 
5 library of complimentary content for CD's the company has in the 
market. The software of the present invention operate as a 
plug-in to a users web browser and directs a user with a record 
company' s CD to a particular section of the central library 
appropriate for the user's CD. 

10 In another aspect of the present invention, called "CD 

Watcher" data representative of the users listening habits 
relative to a record company's CD is transferred to the record 
company when complimentary content is delivered to the user over 
a network connection. 

15 Alternatively, record companies contributing and 

maintaining the central library have access to the listening 
habits of all users who have accessed the central library for 
complimentary content. 

In another aspect of the invention, software is provided 
which permits a computer program running on a remote host to 
control a distributed media player such as a compact disk (CD) 
player, DVD player, or the like on a user's computer. (For 
convenience, we use the term "CD" to refer to all distributed 
media and the term "CD player" to refer also to all distributed 
media players such as DVD players and similar devices.) The 
software is designed to permit the remote host both to initiate 
actions on the CD player and to become aware of actions which 
the user has initiated by other control means, such as the 
buttons on the CD player's front panel or a different CD player 
control program. This aspect of the invention is a building- 
block for the provision of complementary entertainment for CD 

y 
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content when those recordings are fixed in the prevailing 
contemporary form, the CD. 

In another aspect of the invention, visual content, 
including interactive content, may be delivered over an on-line 
serv.ce in such a way that it is synchronized to the delivery of 
content from a musical recording. Such visual content may, for 
example, be synchronized to the playing of an audio CD or other 
distributed media in the user's computer. The visual content is 
thematically linked to the musical recording, for example in the 
10 manner of a music video. 

in a further aspect of the invention, a method is provided 
for determining or assigning a substantially unique identifier 
to CD or other distributed media content consisting of a number 
of tracks. A unique identifier is a useful complement to the 
15 delivery of supplementary content in conjunction with the 

Playing of a CD or other distributed media in that it allows the 
software which delivers the supplementary content to be sure 
that the CD is in fact the correct CD to which the supplementary 
content corresponds. If the su Ppl ementary content is designed, 
for example, to accompany the Rosary Sonatas of Heinrich Ignaz 
Franz Brber, it would presumably not function well if the CD or 
other distributed media in the user's player were the soundtrack 
for the film Mary Poppins. The unique identifier also allows a 
CD or other distributed media to be used as a key to access a 
5 premium Web area. Furthermore, the unique identifier can allow 
the user to be directed to an area of the Web corresponding to 
the CD or other distributed media which is in the user's 
machine. 



30 



in a still further aspect of the invention, the intensely 
Popular on-line service generally referred to as a "chat room- 
may be enhanced by means of a link to a CD recording which all 
Persons in the room are playing. A remote host may control 



<wo «847oea«jL> 



SUBSTITUTE SHEET (RULE 26) 



WO 98/41080 PCT/US98/07660 



distributed media players in multiple, remote locations The chat 
room experience as it exists today in on-line services has a 
disembodied quality by comparison with traditional face-to-face 
social encounters in which there are identifiable surroundings . 
5 The only common experience to the chat users today are the words 
of the chat as they fly by on a computer screen, and perhaps the 
user icons ("avatars") or other visual content occupying a small 
space on the screen. The use of a musical recording in 
conjunction with a chat room opens up the possibility of 
10 restoring to the experience a degree of the shared ambience of 
traditional social encounters. Furthermore, shared content such 
as a musical recording offers a focal point that allows chat- 
seekers to group together by means of shared interests in a 
particular type of recording. 

15 BRIEF DESCRIPTION OP THE DRAWINGS 

Fig. 1 is a network diagram of a first embodiment of the present 
invention. 

Fig. 2 is a flow diagram of the embodiment shown in Fig. 1. 

Fig. 3 is a block diagram of the environment in which the 
20 present invention operates. 

Fig. 4 is a block diagram of complimentary content according to 
an aspect of the present invention. 

Fig. 5 is a flowchart of the synchronization code of the 
invention. 

25 Fig. 6 is a flowchart of the sequence of operations for 
connecting the present invention to a chat room. 
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DESCRIPTION OP PREFERRED EMBODIMENTS 

Referring to Fig.' s 1 and 2 , an embodiment ^ 
invention dynamically connects a user playing a CD with 
host for data exchange. At bi ock n th ' * r6m ° te 

5 host and requests a 1 , w ^ t0 3 remote 

requests a download of client 26. To receive the 

download the user must provide some basic lnfoiB1 . tlon ™ ^ 

mail, chat name, etc Th* r- • «- name ' e " 

for client 26 . blo " k £ inf0rMti ° n 

Mock ha. At block 10A user computer 10 1. 
running computer program 12 such as a browser 
' At biock 30A insertion of CD 30 into player 32 tr 

by client 26. Client 26 tak Pagers action 

30 CD .1 C ° ntr01 ° f PlSi,er 32 «" ^ans CD 

CUent 26 uses the results of the CD scan to calculate a 

substant.ally unique CD ID 31, block 34. Some CD-s ma 

T » te*t file or IRC code, there is no JZ^ ZZ 

us an D ^calculation technique may yield a useful ID w 'any 
CD T>us technique may create a pattern match 3ir by samplino a 
ubset of the content of CD 30 and using the sample to Z Z a 
ubstant.au, unique pattern match ,„ of CD 30. while client 
6 „ calcuiating CD ID 31 , at block K Qss dem r ° 1 " 

« .!» collected and temporarily stored by client 26. 

use profMT'^r^ " in ° 1Ud " iS ^ to CD 

use profiles including most used tracks 

used CDs, average length of time U "' B °' t 

9 ° f tlme computer 10 is runnincr 
o ware aded , most used softuare _ softwa ^ nq. 

concurrently with client and the like. 

Calculation of a CD in ■■ 

a>o ID 31 stimulates client 26 to direci- 

computer program 12 to check a ] nMl u 

in *i ■ 31 Cacne for CD ID 31. if CD 

: ir; i;~ the r ai — — « — - 

— -nt 26 may 1^ TZ^^^T^ 
server ,0 is established, client 26 sends CD XD 31 to lookup 
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server 40. Look-up server 40 compares CD ID 31 against table 
42. Table 42 is a look-up table linking CD ID' s with some 
associated content and with particular addresses having 
complimentary content. Other information such as timing and 
5 control data, electronic coupons, advertisements and bonus 

content such as video with timing and control data may also be 
contained in table 42. At block 44, look-up server 4 0 sends 
information such as address 46 to the user in response to 
receipt of CD ID 31. The information sent to the user may or 
10 may not be based on the user demographic data and use 

demographic data 62 sent to look-up server 40. At block 48 
client 26 establishes a link to address 46. Address 4 6 may be a 
premium or subscription site such as site 51A in which case CD 
ID 31 may operate as a password. 

15 In one aspect of the present invention, content suppliers 

51-56 such as record companies 1-6 respectively, maintain a 
central library 50 on the web. Content suppliers may also 
include advertisers, CD retailers, and other content rights 
holders. Central library 50 may be on a single server such as 

20 ^ look-up server 40 or it may be distributed. Central library 50 
contains the complimentary content sites such as site 51A linked 
by the addresses in table 42 such as address 46. Each content 
supplier 51-56 may change the content of their site and add new 
links to additional sites as new CD's are. released. As new 

25 sites are added, new CD ID' s and linked addresses are added to 
table 42. 

At block 49A, server 58 hosting site 51A transfers 
complimentary content 60 to. the user's computer 10. Once the 
user is linked to site 51A, client 26 sends stored use 
30 demographic data 62 and CD status data 64 to look-up server 40 
and or server 58. At block 66 client 26 continues to update and 
transfer use demographic data 62 and CD status data 64 to look- 
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up server 40 and or server Sfl ae i 

Closed loop up date 70 pelt ' " ^ " 

content . , 3 C ° ntent 8U PP"«' such as 

content suppliers 51-56, a real-ri ma 

»Mch CDs are in use and re a v 7 real "" me ^ " 

5 ele„ents and rented J \ """^ " "" ° f CD 

— — -::=^r:arr::.:: - 

In another embodiment- . 

' «ida Web. The HTTP D Z , lnVentl °" ° PerateS ° n th * 

6 HTTP Protocol on the web is run atoo a , 

connection-oriented protocol wh.Vh , „ • 9 
described in Douglas E Come' r * " 9 "" ,Uy 

"95, . Ho „eve 1 -*« TCP/IP (3d 

However, the invention described here is nn. i • 
to HTTP running over any particular kind f \ * 

hardware. The principles of the ' " 

pxes of the invention apply to other 

»f~:;*:-n:r::r.::.: :~ 

client software tk^ k otner 

oftware. The browser sends out HTTP requests U to 
other computers, referred ^ « 

eierred to as servers such as server 16 m 
requests, particular items of , server 16. i n 

whl>h tSmS ° f data ' referred to as resources 

which are available on servers * ' 

uniform servers, are referred to by means of 

uniform resource locators (URL' s) , character strings in a 
particular format defined in Berners-Lee et al 7 
-ludes both an identification of the le^ and T' ^ ^ 
identification of a particular * . 

Retina to the revests t he S e ^ S * rV «- 

user's browser zr,7H I * reSP ° nS " 18 to "» 

browser, and the browser acts upon those responses 

.enerall, b y dis P la ytng so.e sort o f content to the user 

The content portion r>f <-k« 

the res P°nses can be a "Web oaae 
e^essed in the hyp erte xt m ar k up i anguage (Hm , 
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20 and 22. That language allows one to express content 
consisting of text interspersed with bitmap-format images and 
links (also known as anchors and hyperlinks) . The links are 
further URL's to which the browser may, at the user's prompting, 
send further requests. 

The responses can also include more complex commands to be 
interpreted by the browser, e.g., commands which result in an 
animation as discussed below for Fig. 4. HTML itself does not 
define complex commands, but rather they are considered to 
belong to separately-defined scripting languages, of which two 
currently common ones are JavaScript and VBScript. 

In addition to extending the function of the browser by 
means of code written in a scripting language, it is also 
possible to extend the function of a browser with compiled code. 
Such compiled code is referred to as a "plug-in." The precise 
protocol for writing a plug-in is dependent on the particular 
browser. Plug-ins for the Microsoft browser are referred to by 
the name of ActiveX controls. 

Plug-ins may be very complex. A plug-in which may 
advantageously be used in connection with the invention is 
Shockwave from Macromedia. It permits animations which are part 
of a server response to be downloaded and played to the user. 
Shockwave defines its own scripting language called Lingo. 
Lingo scripts are contained within the downloadable animations 
which the Shockwave plug-in can play. The general format of a 
Shockwave animation is a timeline consisting of a series of 
frames, together with a number of visual objects which appear, 
perform motions, and disappear at particular frames within the 
timeline. To achieve more complex effects within a Shockwave 
animation, Lingo scripts may be invoked in addition to 
predefined visual objects. 
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A currently preferred embodiment of the present invention 
employs a plug-in, referred to as the command plug-in 24, which 
provides to a scripting language the ability to command and 
monitor in a detailed fashion the playing of a CD recording 
The command plug-in should provide and monitor, at a minimum, 
the following basic functions: 



(1) Start and stop play. 

(2) Get current track and position within the track. 
Seek to a track and a position within the track. 



(3) 

10 (4) Get and set volume 



(5) Get information regarding the CD (e.g., the number of 
tracks, their lengths, the pauses between tracks). 

(6) Get information regarding the capabilities of the CD 
drive . 

Other functions may be provided and monitored, limited only 
by what the underlying operating system services are able to 
accommodate. The monitored functions are included in use 
demographic data 62 which is transferred to server 4 0 and or 
servers such as server 58. 

The command plug-in may be written in a conventional 
programming language such as C ++ . The plug in must conform to 
the existing standards for plug-ins, such as those required of 
Microsoft ActiveX objects, m order to obtain the information 
and carry out the functions which the command plug-i n makes 
available to the scripting language, the command plug-i n relies 
on functions which provide control and information regarding the 
Playxng musical recording. These functions will depend on the 
precise source of the recording. If, as in one embodiment of 
the present invention, the recording being played is an audio CD 
« the computer CD player, and if the browser is running under 
Microsoft Windows 3.1 or Windows 95 or Windows CE, these 
functions would be the MCI functions, which form a part of the 

to 
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Win32 application programming. interface. These functions are 
documented, for example, in Microsoft Win32 . Programmer' s 
Reference. Different functions may be provided by streaming 
audio receivers, as for example receivers which capture audio 
which is coming into the user's computer over a network 
connection in a suitable audio encoding format such as MPEG. 

An important point to note about the implementation of the 
command plug-in is that the operations which it carries out, as 
for example "seeks", may take times on the order of a second. 
It is undesirable for command-plug-in 24 to retain control of 
computer 10 during that interval, so it is important that 
command plug-in 24 relinquish control of computer 10 to the 
browser whenever a lengthy operation is undertaken, and report 
on the results of the operation via the asynchronous event 
handling capability used in the common scripting languages. 

Given the above summary of the functions which the command 
plug-in provides, a general knowledge of how to write plug-ins 
(e.g., of how to write ActiveX objects), and a knowledge of the 
relevant application programming interface for controlling the 
play of the CD (e.g., MCI in Win32), a person skilled. in the art 
could readily and without undue experimentation develop an 
actual working command plug-in. For this reason, further 
details of how the command plug-in is implemented are not 
provided here. 

The existence of a command plug-in providing the functions 
listed above to a scripting language is a foundation on which, 
entertainment complementary to the content of a CD may be 
constructed. In particular, it is possible to devise, building 
on this foundation, a method for synchronizing the display of 
complementary content by means of the scripting language with 
the events which are occurring on the CD. 
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Referring now to Fig. 4 and 5, synchronization of the 
complementary content to the CD proceeds as follows. For 
example, complimentary content 60 may be provided by means of 
anima 1D „ such as Shockwave animation, including frames „.,, and 

» 1 I COmPUmenta ^ conte " «0 is downloaded from server 
58 and displayed for the user by means of a Shockwave plug-in 
This downloading may take place before the animation is 
^played or alternatively it make take place as the animation 
is being displayed, provided the user's connection to the 
network is fast enough to support download at an appropriate 

As the Shockwave animation is played, script 72 such as a 
Lingo script executes each time a frame finishes displaying. 
The Lrngo script contains a description of the reiationship 
w,c h should exist between frames of the animation and segments 
of the CD content, identified by track number and by time. The 
Lingo script determines, by means of the command pl U g-i„ 

20 TT^ " " hiCh '"^ time the ° f th. CD is. 

It then refers to the description in order to determine which 
frames of the animation correspond to that portion of the CD. 
" the current frame is not one of those frames, the Lingo 
scrrpt resets the time line of the animation so that the . 
animation will begin to play at the frame which corresponds to 

t cat U cT nt T itl0n ° f ^ ™ S >~"' «» ™ 

to catch up rf lt ever lags the CD _ for 

downloading from the network has fallen behind, because the 
user s computer lacks the cycles to play the animation at full 
speed, or because the user has fast-forwarded the CD. 

50 controTCL::: li:: :• the » — * - 

dividual frames or groups of contiguous frames, 
complimentary content 60 includes frames F,-F„ and script 72 



At 
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block 200, a correspondence is established between each frame F n 
or group of frames and a particular segment of CD 30, At the 
end of each frame F n of the animation block 205, the position of 
CD 30 is determined, block 210. A test is done at -block 215 to 
5 determine whether the position of CD 30 is within the segment of 
the recording that corresponds to the group of frames to which 
the next sequential frame belongs. If the position of CD 30 is 
within that segment, the playback of the animation proceeds with 
the next frame, block 230. If the position of CD 30 is not 
10 within that segment, then at blocks 220 and 225 the playback of 
the animation is advanced to the frame corresponding to where 
the CD is. 

A further aspect of the present invention is a touring 
mode'. With client 26 in touring mode, a remote device such as 
15 server 58 may control one or more user devices through delivery 
of complimentary content 60 interspersed with player 26 control 
data to provide the one or more users with a guided tour of a 
particular distributed media such as CD 30. 

A further aspect of the invention is the ability, by making 
20 use of command plug-in 24, to provide a technique for 

establishing a unique identifier for a CD, CD ID 31, which is 
located in the user's CD player 32. The unique identifier may 
be based on the number and lengths of the tracks (measured in 
blocks, ' i.e. , l/75ths of a second), so that the identifier would 
25 be a concatenation of these lengths. In practice, however, it 
is desirable to have a somewhat shorter identifier, so the 
unique identifier is preferably the concatenation of the track 
lengths expressed in a fairly coarse unit, such as 1/4 th of a 
second. 

30 Appendix A contains source code, written in C, for a fuzzy 

comparison algorithm suitable for determining whether two audio 
CDs are exactly or approximately the same. The fuzzy comparison 
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algorithm proceed as follows, for each of the two ^ CDs 
be compared, one Ceteris the lengths of all the trackl ln t e 
record g in milliseconds . ^ ^ ^ tracfc C n „ > 

' 21 256 - 0ne "en goes through both of the 

n r lT n9 : h traCk ^ traCk ' '"-^"n, as one proceeds two 
numbers the match total and the match error. These numbers are 

? t ? lized to 2ero at the start ° f the " 

each o, the tracks, one increments the match tot al by tne 
> shrfted length of that tract in the first CD to he compared and 
one rncrements the match error by the abaolute yaiue -J ° ' 

CDs When one gets to the l ast tree* in the CD with the fewer 
per of traces, one continues with the tracks in the other CD 

hrfted lengths of those tracks, blowing these steps of going 
rough ^ the algoritim ^^^^^ 

by the match number, subtracts the resulting guotient from !, 
and converts the difference to a percentage which is indicative 
of how well the two CDs match. 

Appendix B contains source code, written in c, for a 
comparison algorithm suitable for determining whether two a udio 

nl 7 * Same - al9 ° ritta "»«— the 

TZ t " aCk le " 9thS ' ^ thS - "mes 

of the tracks an 8-byte value. The high order . bytes are 

obtained by summing the start and end times of all tracks 
expressed in milliseconds. The low order < bytes are obt ined 

ehrftmg the sum left ten bits, and adding the number of tracks. 

Site ^ emPl ° yed " 3 datataSe key - * » 

site 52A may maxntain a database of information about CDs for 

example information a bout all CDs issued by record company 2 can 
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be maintained on that record company's site. There are various 
alternative ways for users to navigate this , information. For 
example, they could use a Web page containing many hyperlinks as 
a table of contents, or they could use a conventional search 
5 engine. A third way of searching, which is enabled by CD ID 31 
of the invention, is for there to be a Web page which invites 
the user to place in player 32 the CD about which he or she is 
seeking information, for example CD 30. Upon detection of the 
presence of CD 30 in the drive, a script in the Web page 

10 computes CD ID 31 corresponding to CD 30 and sends it to server 
58. Server 58 then displays information about the CD retrieved 
from a database on the basis of CD ID 31. This information may 
include a Web address (URL) that is related to the CD (e.g., 
that of the artists' home page), simple data such as the names 

15 of songs on the CD, and also complementary entertainment, 

including potentially photographs (e.g., of the band), artwork, 
animations, and video clips. It is also possible to arrange 
things so that, when the user inserts .a CD into the computer, 
(i) the Web browser is launched if not already running, (ii) the 

20 browser computes the CD' s unique identifier and from that unique 
identifier derives a URL, and (iii) the browser does an HTTP get 
transaction on that URL. 

An alternative application of unique identifiers for 
musical recordings is to employ a CD as a key for entering into 

25 a premium area of the Web. There are presently premium areas of 
the Web to which people are admitted by subscription. A simple 
form of admission based on the unique identifier is to require, 
before accessing a particular area of the Web, that the user 
place in his or her CD drive a particular CD, or a CD published 

30 by a particular company or containing the music of a particular 
band or artist. This is readily accomplished by means of a 
script which invokes the functions provided by the command plug- 
in and computes a unique identifier. 
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Another aspect of the invention is the connection of chat 
rooms with musical recordings. The goal is to provide all 
participants in a chat room with the same music at approximately 
the same time. 

One. conventional network protocol for chat services is 
Interney Relay Chat (IRC), described J. Oikarinen & D. Reed, 
Internet Relay Chat Protocol (Internet Request for Comments' No. 
1459, 1993). m this protocol, when one becomes a client of a 
chat server, one sends the name of a chat room. The chat server 
receives messages from all of its of clients and relays the 
messages sent in by one client to all the other clients 
connected in the same room as that client. The messages which a 
client sends are typically typed in by the user who is running 
the client, and the messages which a client receives are 
typically displayed for the user who is running the client to 
read. 

In a preferred embodiment of the invention, a chat client 
is customized by means of a plug-in, which we will call the chat 
plug-in. The chat client is started up by a browser as follows 
(see Fig. 5) . The user connects by means of the browser to a 
central Web page (box 300) which, upon being downloaded, asks 
that the user insert a CD into his or her player (box 305). A 
unique identifier of the CD is computed and communicated back to 
the server by using the control plug-in described above under 
the command of a script in the central Web page (box 310) . The 
server then employs the unique identifier to determine whether 
it has a chat room focused on the CD (box 315) . This step may 
be carried out by looking the unique identifier up in a database 
using techniques well known in the art. There exists a vast 
literature on connecting Web pages to databases, e.g., December 
& Ginsburg, supra, chapter 21. if a chat room focused on the CD 
exists or can be created, the server responds with the name of 
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that chat room, and the browser starts up a chat client on the 
user's computer as a client of that chat room (box 320). 

The chat room' s name is set by the server to contain 
information about the track which the CD is playing in the other 
5 chat room clients' machines and the time at which the track 

started to play, as well as about the volume at which the CD is 
playing- The chat client plug-in employs that information to 
direct the control plug-in to set the CD in the user' s computer 
to play in such a manner that it is approximately synchronized 
10 to the CD which is playing in the other chat room clients' 
machines (box 320) . 

Each user in the chat room is able to control the CD which 
is playing in his or her machine. Control actions result in the 
chat plug-in sending messages to the chat server which describe 

15 the control action being taken (box 325) . For example, such 
messages may indicate a change in the position of the CD, a 
change in the volume, or the ejection of the CD to replace it 
with another. The chat plug-ins running on the other users' 
machines, upon seeing a message of this kind, replicate the, 

20 action (as far as possible) on the other users' machines by 
using the control plug-in described above (box 330) . 

In a further aspect of the invention, a chat room focused 
on a particular musical recording might allow for a voting 
procedure to select particular tracks. A simple voting 

25 procedure would be for each chat plug-in to act upon a change 
message of the kind described in the preceding paragraph only 
when it sees two identical consecutive change messages. This 
would mean that in order to change the track which is being 
played, it would be necessary for two users to change to that 

30 track. The number two may be replaced by a higher number. 

n 
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in a further aspect of the invention the „,essa 9 es delivered 
to the users of a chat can be driven fro* a teat file rath 
than „anual typino. This „ ould ^ pre . re J^* /"^ 

to Played hac k f oc a 9 roup of chat u e s 12 a McT"" 
may be used to create „ „ technique 
create a pre-recorded, narrated tour of an audio 

that u l mP T nt adVant39e ° f Mb ° dlment above is 

tnat it may be used with anv 

the .ini^a! functional ZZ^TV^^ ™= 

y re( iuired by Internet Relav Chat nr- k„ 
a protocol providino ^^i, . . Y fc or b y 

providing similar minimum chat service. The 
additional software ra j • , 

- and in the central! T a^ ItTltVcV" ^ ^ 

. . , ^ ye ' Wltn its connection to a 

database of CD information. 



19 
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APPENDIX A 

/* 

* FUZZY CD ID 

* (c) 1996-1998 ION Inc. 
★ 

* 

* by Ty Roberts 
*/ 

#include <stdio.h> 
#include <stdlib.h> 
#include <time.h> 

struct fuzzyCDid { 

short numberTracks; // start time in 

milliseconds 

unsigned short fuzzlength [100] ; 

}; 

typedef struct fuzzyCDid fuzzyCDid, *f uzzyCDidPtr; 

// structure of a cd track with all times stored in milliseconds 

struct cdtrack { 4 
long beginMs; // start time in milliseconds 
long endMs; // end time in milliseconds 

long lengthMs; // length in milliseconds 

>; 

typedef struct cdtrack cdtrack, *cdTrackPtr; 

struct cd { 

short numberTracks; 
cdtrack track [100] ; 

}; 

typedef struct cd cd, *cdPtr; 

void CreateFuzzyId( fuzzyCDidPtr fid, cdPtr cd ); 

float FuzzyMatch( fuzzyCDidPtr fidl, fuzzyCDidPtr fid2 ); 

// SUBROUTINES 

void CreateFuzzyId( fuzzyCDidPtr fid, cdPtr cd ) 
{ 



ft 
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long i ; 



//first copy in the number of tracks 
fxd^numberTracks = cd->numberTracks; 

for (i=0; i<f id->numberTracks; { 

lenathMss.xo\ . ' VWVJ 



>track[i] .lengthMs»8> / 
} 



float ru.zyM.tch, fuzzyCDidPtr tin, fuzzyCDidPtr f id2 , 

|ort fi *"V^^ ; °- . ., 

loat matchpercent; 

^aftet th %-2f"" r nMber of tra = k = 
^erTrS 7 S^SS^ 1 *-*"^™* ' 

=om P aredt£s '"^ -^"Ina error and total 

for(i=0;i<trackcnt;i++) { 
>nuntoerTra£LnY f idl - >numberT "^s, && (i < fid2 _ 

>fu 2Z length[i])f idmatCherr += abs < f ^l->fuz 2 length [i] - fid2 _ 

*.Z u >- fld2 ->numberTracks) { 
fidmatcherr += f idl->fuzzlength [i] • 
fidmatchtotal + - fidl->fuzzw£h 111 • 

} else ;f (i >- fidl->numberTracks" g { 

fidmatcherr +- f id2->f UZ2 length [i] ; 

} fidmatchtotal + - f id2->f U22 lLgth [i] ; 



} 



if (fidmatcherr > 0) { 

matchpercent =100- 
< ( <"oat) fictaatcherr/ (float, fictaatchtotal, n00, ; 

matchpercent = 100; 
^ return matchpercent; 
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void main (void) 

{ 

short i; 

float mat chpercent ; 



// create global structures for two complete cds with up t 
100 tracks 

cd cd2id; 
fuzzyCDid fidcd2id; 
cd cdFromDB; 



fuzzyCDid fidcdFromDB; 

printf ("Test #1 will compare two CDs that are exactly the 
same\n\n") ; 

// put in some test values for the cd track lengths 

// since these are in ms, its basically 60000 = 1 minute 



cd2id. track (0] .lengthMs = 121323; 
cd2id.track[l] .lengthMs - 234565; 
cd2id.track [2] .lengthMs = 566437; 
cd2id.track[3] .lengthMs = 245120; 
cd2id.track[4] . lengthMs = 20000; 
cd2.id.track[5] .lengthMs « 120386; 
cd2id. track [6] .lengthMs = 323453; 
cd2id.numberTracks = 7; 



for (i=l;i<cd2id. numberTracks; i++) { 

printf ("CD #1: Track = %d length in minutes = %f\n 
i, (float)cd2id.track[i] . lengthMs/60000 . 0) ; 

} 

printf ("\n") ; 

cdFromDB. track [0] .lengthMs = 121323; 

cdFromDB. track [1] .lengthMs « 234565; 

cdFromDB. track [2] .lengthMs = 566437; 

cdFromDB. track [3] .lengthMs « 245120; 

cdFromDB. track [4] .lengthMs = 20000; 

cdFromDB. track [5] .lengthMs = 120386; 

cdFromDB. track [6] .lengthMs - 323453; 
cdFromDB. numberTracks = 7; 



for (i=l; KcdFromDB. numberTracks; i++) { 

printf ("CD #2: Track = %d length in minutes = %f\n" 



BNSDOCID: <WO 8847080A2J_> 



SUBSTITUTE SHEET (RULE 26) 



WO 98/47080 

PCT/US98/07660 



} 



i, (float) cdFromDB. track [i] .lengthMs/60000.0 



CreateFuzzyId( &fidcd2id, &cd2id ); 
CreateFuz 2 yId( &f idcdFromDB, ScdFrornDB 



matchpercent = FuzzyMatch( 
printf ("The cd's 
matchpercent) ; 

printf ("\n"); 
printf ("\n"); 



&fidcd2id, &f idcdFromDB 
matchpercent was computed as=%f", 



// Ilnci n th«i test . val "« f>r the cd track lengths 

cd2id. track [ 1] .lengthMs = 234565* 
cd2ad.track[2] .lengthMs = 566437 
cd2 id. track [3] .lengthMs = 245120 
cd2id. track [4] .lengthMs = 20000; 
cd2id.track[5] .lengthMs = 120386; 

cd2id.track[6] .lengthMs = 323453; 
cd2id.numberTracks = 7; 

for (i=l;i<cd2id.nvimberTracks;i++) { 

printf ("CD #l: Track = %d length in minutes - %f\ n " 
i, (float)cd2id.track[i].lengthMs/60000.0 ); 



printf (" 
cdFromDB. 
cdFromDB. 
cdFromDB . 
cdFromDB. 
cdFromDB. 
cdFromDB . 
cdFromDB 



An"); 

track [0] .lengthMs 
track [1] .lengthMs 
track [2] .lengthMs 
track [3] .lengthMs 
track [4] .lengthMs 
track [5] .lengthMs 
numberTracks = 6; 



121323 
234565 
566437 
245120 
20000; 
120386; 



for ( i-1 ; KcdFromDB . numberTracks ; i++) / 

} (float)cdFro ^B.track[i].lengthMs/60000.0 ); 



CreateFuzzyld( &fidcd2id, &cd2id 



); 
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CreateFuzzyld ( &f idcdFromDB, &cdFromDB ); 
matchpercent = FuzzyMatcM &fidcd2id, &f idcdFromDB ); 

printf ("Thecd's matchpercent was computed 
as=%f 11 , matchpercent) ; 
printf ("\n"); 
printf ("\n") ; 

printf ("Test #3 will compare two cd that are not the 
same\n\n") ; 

// put in some test values for the cd track lengths 

// since these are in ms, its basically 60000 = 1 minute 

cd2id.track[0] . lengthMs = 34213; 

cd2id.track[l] .lengthMs = 334565; 

cd2id.track[2] .lengthMs = 231423; 

cd2id.track[3] .lengthMs = 134122; 

cd2id.track[4] .lengthMs = 2342; 

cd2id. track [5] .lengthMs - 3487; 

cd2id. track [6] .lengthMs = 9976; 

cd2id.numberTracks =7;. 

for ( i=l ; i<cd2 id . numberTracks ; i++ ) { 

printf ("CD #1: Track = %d length in minutes = %f\n", 
i, (float) cd2id.track[i] . lengthMs/60000 . 0 ); 

} 

printf ("\n"); 

cdFromDB. track [0] .lengthMs = 121323; 

cdFromDB. track [1] .lengthMs = 234565; 

cdFromDB. track [2] .lengthMs = 566437; 

cdFromDB. track [3] .lengthMs = 245120; 

cdFromDB. track [4] .lengthMs = 20000; 

cdFromDB. track [5] .lengthMs = 120386; 

cdFromDB. track [6] .lengthMs = 323453; 
cdFromDB. numberTracks =6; 



for ( i=l ; KcdFromDB . numberTracks ; i++ ) { 

printf ("CD #2: Track = %d length in minutes = %f\n", 
i f (float) cdFromDB. track [i] . lengthMs/60000 . 0 ); 

} 

CreateFuzzyld ( &fidcd2id f &cd2id) ; 
CreateFuzzyld ( &f idcdFromDB, &cdFromDB) ; 

matchpercent = FuzzyMatch( &fidcd2id, &f idcdFromDB ); 
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APPENDIX B 

/* 

* EXACT MATCH CD ID 

* © 1996-1998 ION Inc. 
★ 

★ 

* by Ty Roberts 
V 

#include <stdio.h> 
#include <stdlib.h> 
#include <time.h> 

struct cdid{ 

long id [2] ; 

>; 

typedef struct cdid cdid, *cdidPtr; 

// structure of a cd track with. all times stored in milliseconds 

struct cdtrack{ 

long beginMs; // start time in miliseconds 
long endMs; // end time in milliseconds 

long lengthMs; //length in Miliseconds 

>; 

typedef struct cdtrack cdtrack, *cdTrackPtr; 

struct cd { 

short numberTracks; 
cdtrack track[100]; 

}; 

typedef struct cd cd, *cdPtr; 

void CreateUniqueId( cdidPtr cid, cdPtr cd ) ; 
// SUBROUTINES 

void CreateUniqueld ( cdidPtr cid, cdPtr cd ) 
{ 

long i, t, n; 

t = 0; 
n = 0; 
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for ( i=0 ; i<cd->numberTracks ; i++ ) ' { 

// shift left and create a MSB 
t += cd->track[i] .lengthMs; 
n +- cd->track[i].beginMs + cd->track[i] 



} 

cid->id[0] = t«10+cd->numberTracks; 
cid->id[l] = n; 



length thats not exact 
endMs ; 



} 



void main (void) 

. { 

short i; 

short matchtest; 

100 tra'ckT^ 9l ° bal StrUCtures two complete cds with up to 
cd cd2id; 
cdid cd2UID; 

cd cdFromDB; 
cdid cdFromDBUID; 

sameXnTn"" '" TeSt #1 " iU C ° mP " e tm Cd that a " — tly the 
// put in some test values (or the cd track lenoths 

cd2id. track [1 ] .beginMs - 100001, 
cd2id. track [2] .beginMs = 231001; 
cd2id.track[3] .beginMs = 345001; 
cd2id. track [4] .beginMs - 435001; 
cd2id. track (5] .beginMs = 460001; 
cd2id. track [6] .beginMs = 590001; 

cd2id. track [0] .endMs = 100000; 
cd2id. track [1] .endMs = 231000; 
cd2id. track [2] .endMs = 345000; 
cd2id. track [3] .endMs = 435000; 
cd2id. track [4] .endMs = 460000; 
cd2id. track [5] .endMs = 590000; 
cd2id. track[6]. endMs = 690000; 

=a2i d ???acnsr b k i^„Ms e r hMs = cd2w - trac kioi - enaMs - 
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cd2id. track [ 1] .lengthMs » cd2id. track [1] .enclMs * 
cd2id . track [ 1 ] . beginMs ; 

cd2id. track [2] .lengthMs - cd2id.track[2] .endMs - 
cd2id. track [2] -beginMs; 

cd2id. track [3] .lengthMs = cd2id.track[3] .endMs - 
cd2id. track[3] .beginMs; 

cd2id. track [4] .lengthMs = cd2id. track [4] .endMs - 
cd2id. track [4] .beginMs; 

cd2id.track[5] .lengthMs = cd2id. track [5] . endMs - 
cd2id, track [5] .beginMs; 

cd2id. track [6] .lengthMs = cd2id.track[6] .endMs - 
cd2id. track[6] .beginMs; 

cd2id.numberTracks = 7; 

for ( i=l ; i<cd2id . numberTracks ; i++ ) { 

print f ("CD #1: Track = %d length inminutes - %f\n", 
i, (float) cd2id.track[i] . lengthMs/60000 . 0 ); 
} 

printf ("\n") ; 

cdFromDB. track [0] .beginMs = 0; 
cdFromDB. track [1] .beginMs = 100001; 
cdFromDB. track [2] .beginMs = 231001; 
cdFromDB. track [3] .beginMs = 345001; 
cdFromDB. track [4] .beginMs = 435001; 
cdFromDB. track [5] .beginMs = 460001; 
cdFromDB. track [6] .beginMs = 590001; 
cdFromDB. track [0 ] .endMs = 100000; 
cdFromDB. track [1] .endMs = 231000; 
cdFromDB. track [2] .endMs = 345000; 
cdFromDB. track [3] .endMs = 435000; 
cdFromDB. track [4] .endMs = 460000; 
cdFromDB. track [5] .endMs = 590000; 
cdFromDB. track [6] .endMs = 690000; 

cdFromDB. track [0] .lengthMs = cd2id. track [0] .endMs - 
cd2id. track[0] .beginMs; 

cdFromDB. track [1] .lengthMs = cd2id. track [1] .endMs - 
cd2id. track [1] .beginMs; 

cdFromDB. track [2] .lengthMs = cd2id. track [2] .endMs - 
cd2id. track [2] .beginMs; 

cdFromDB. track [3] .lengthMs = cd2id. track [3] .endMs - 
cd2id. track [3] .beginMs; 

cdFromDB. track [4] .lengthMs = cd2id. track [4] .endMs - 
cd2id. track [4] .beginMs; 

cdFromDB. track [5] .lengthMs = cd2id. track [5] .endMs - 
cd2id. track [5] .beginMs; 



V) 
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cdFromDB . numberTracks = 7 ; 
for(i-l;i<cdFromDB-numberTracks;i++) f 

printf ("CD #2- TrarV - s-w n . , 

i. '^oat,c d rro„DB.tr a L; i j"e C „ k g ^ /60 ^S 9 S h ,? nminUteS " %fW ' 

CreateUniqueldf &cd2UID, &cd2id ); 

cd2UID^U] i'r^ 10 C ° #1 = %d%d ^"' cd20ID.id[0] # 

Drin«/ n -n UeId( &cdFromD BUID, ScdFromDB ), 
printf ( "Unique ID for CD #? - *h*h\„» ^ 
cdFromDBUID. id [1] J, ' %d%dVn ' cdFromDBUID. id [0] , 

..d^siir-: iD - id[oi ' « 

-tchE^^^f « »«lt is „on zero 
printf ("\n"); 
printf ("\n"); 

/ / put in some test values for fh a ^ 

cd 2id-track[l].beginMs = 100001; 
cd2id.track[2].beginMs = 231001; 
cd2id.track[3].beginMs = 345001; 
cd2id.track[4].beginMs = 435001; 
cd2id.track[5].beginMs = 460001- 
cd2id..track[6] .beginMs = 590001- 
cd2id. track [0] .endMs = 100000' 
cd2id. track [1] .endMs = 231000* 
cd2id.track[2] .endMs = 345000 
cd2id. track [3] .endMs = 435000 
cd2id. track [4] .endMs = 460000 
cd2id. track [5] .endMs = 590000 
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cd2id. track [6] .endMs = 690000; 



cd2id. track [0] .lengthMs = cd2id. track [0] . endMs - 
cd2id. track [0] .beginMs; 

cd2id. track [1] .lengthMs - cd2id. track [1] .endMs - 
cd2id. track [1] .beginMs; 

cd2id.track[2] .lengthMs = cd2id. track [2] .endMs - 
cd2id.track[2] .beginMs; 

cd2id. track [3] .lengthMs = cd2id. track [3] . endMs - 
cd2id.track[3] . beginMs; 

cd2id. track [4] .lengthMs = cd2id. track [4] .endMs - 
cd2id. track [4] .beginMs; 

cd2id. track [5] .lengthMs = cd2id. track [5] .endMs - 
cd2id. track [5] .beginMs; 

cd2id. track [6] .lengthMs = cd2id. track [6] .endMs - 
cd2id. track[6] . beginMs; 

cd2id.numberTracks =7; 



for ( i=l ; i<cd2id . numberTracks ; i++ ) { 

printf ("CD #1: Track = %d length inminutes = %f\n", 
i, (float) cd2id. track [i] . lengthMs/60000. 0 ) ; 
} 



printf ( 
cdFromDB 
cdFromDB 
cdFromDB 
cdFromDB 
cdFromDB 
cdFromDB 
cdFromDB 



"\n"); 
. track[0] 
. track[l] 
.track[2] 
. track[3] 
.track [4] 
.track [5] 
. track[6] 



.beginMs 
.beginMs 
.beginMs 
.beginMs 
. beginMs 
.beginMs 
.beginMs 



0; 

100001; 
231001; 
345001; 
435001; 
460001; 
590001; 



cdFromDB. track [0] .endMs = 100000 
cdFromDB. track [1] .endMs = 231000 
cdFromDB. track [2] .endMs = 345000 
cdFromDB. track [3] .endMs = 435000 
cdFromDB. track [4] .endMs = 460000 
cdFromDB. track [5] .endMs = 590000 



cdFromDB. track [0] .lengthMs = cd2id. track [0] .endMs - 
cd2id.track[0] .beginMs ; 

cdFromDB. track [1] .lengthMs - cd2id. track [1] .endMs - 
cd2id. track [1] .beginMs; 

cdFromDB. track [2] .lengthMs = cd2id. track[2] . endMs - 
cd2id. track [2] .beginMs; 
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cd2id C tra%°"(3i? b r : 9 C S: le " 5thMs " ^id.tracWKendMs - 
e.BldfSSSj?^: 1 ^'- " ^id.traCcHl.endMs - 

cdFromDB.numberTracks = 6; 

for ( i-i • i<cdFromDB . numberTracks ; i ++ ) i 

prmtf ("CD #2- Trark- - ha i ^ . 

1. <«-t,cdrro n DB.tracMi].le„ g ^s /6 OOoS 9 5 h ,r inUteS " %fW '' 

CreateUniqueldl scd2UID, scd2id )• 
ocODlSfSuj' ); ni<,Ue 10 f ° r ° D #1 ' %dSdXn "' od20ID.id[01. 

p"n«r"nn eM< ' cdFr °""*UID, ScdFromDB ), 
cdFroSo'lduH; CD " ■ %d%dX ""' «**»WIID.idlO]. 

-tehSSS- i£ "suit is non 2ero 
print f ("\n") ; 
printf ("\n") ; 
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CLAIMS 

I claim: 

1. A method of synchronizing content from a first CD with 
complimentary content from a remote device delivered over a 
network, characterized by: 

playing a first CD (30) on a local electronic 
device (10) to manifest first CD content; 

transferring complimentary content (60) and 
synchronization information (72) from a remote device (40) to 
said local device over a network; and 

controlling said first CD using said synchronization 
information to synchronize manifestation of said first CD 
content with said complimentary content, 

2. The method of claim. 1 further characterized by: 
transferring CD status information (62) from said 

first CD to said remote device over a network; and 

controlling manifestation of said complimentary 
content using CD status information and said synchronization 
information. 

3. The method of claim 1 wherein said first CD includes 
audio content. 

4 . The method of claim 1 wherein said first CD includes 
audio and video content. 

5. The method of claim 1 wherein said first CD includes 
music. 

6. The method of claim 1 further comprising: 
analyzing said first CD; 

computing an identification code based on said content 
of said first CD; and 

3» 
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inform- t 7 3ferrin ' «-Pli~.t«y content and synchronization 
u*««t„» t „ said remote device „ased on said identification 

net J* J v h r th0d ° £ Claim 1 — — is a 

8. The method of cl.i» 1 wherein said remote device is a 
second user device. 

9. A device for synchronizing content from a first 
prerecorded med ia with complimentary . content from a remote 
device delivered over a network, comprising: 

a local electronic device having a video display 
means; ^ y 

a prerecorded content player connected to or integral 
with said local electronic device; integral 

means for transferring complimentary content and 

synchronization informal- i nn 

. mrormation from a remote device to said local 

device over a network; and 

means for controlling said prerecorded content player 
using said synchronization information to synchronize 
manifestation of said f irst prere corded media content with said 
complimentary content. 

10. The device of claim 9 further comprising: 

means for transferring prerecorded media status 
-formation from said f irst prerecorded media tQ said 
device over a network; and 

means for controlling manifestation of said 
complimentary content using prerecorded media status information 
and said synchronization information. 
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11. The device of claim 9 wherein said first prerecorded 
media is a CD, 

12. The device of claim 9 wherein said first prerecorded 
media is a DVD. 

13. The device of claim 9 wherein said first prerecorded 
media includes audio content. 

14. The device of claim 9 wherein said first prerecorded 
media includes audio and video content. 

15. The device of claim 9 wherein said first prerecorded 
media includes music. 

16. The device of claim 9 further comprising: 

means for analyzing said first prerecorded media; 

means for computing an identification code based on 
said content of said first prerecorded media; and 
5 means for transferring complimentary content and 

synchronization information from said remote device based on 
said identification code. 

17. The device of claim 9 wherein said remote device is a 
network server. 

18. The device of claim 9 wherein said remote device is a 
second user device 
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